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SUMMARY 

A  brief  overview  of  the  application  of  System  Identification 
methodology  to  the  analysis  of  dynamic  flight  test  data  is  provided, 
and  the  advemtages  of  this  approach  suanarlsed.  Paurameter  estimation 
is  presented  as  an  important  element  in  the  overall  process  and  a 
number  of  estimation  prograu,  available  on  the  ARL  conputer,  are 
described.  The  advantages  and  disadvantages  of  the  veurious  procedures, 
including  least  squares,  maximum  likelihood  and  Kalman  filter 
techniques,  are  assessed.  Suggestions  are  made  on  factors  to  consider 
in  choosing  the  most  suitable  method,  depending  on  measurements 
available,  noise  levels  and  model  structure. 
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1.  INTRODOCTION 


The  application  of  system  identification  methodology 
to  the  extraction  of  aerodynamic  information  from  flight  test  data 
dates  from  the  mid  sixties,  and  has  been  made  possible  by  the 
develoixnent  of  fast  digital  computers.  Although  flight  test 
conditions  pose  a  difficult  environment  for  making  accurate 
measurements,  considerable  success  has  been  achieved.  Much  of  this 
success  C2m  be  attributed  to  the  availability  of  good  quality  data 
acquisition  systems  and  to  the  existence  of  well  defined  linear 
models  for  the  description  of  the  aircraft  motions. 

The  advantages  offered  by  these  techniques  include 
improved  accuracy  and  decrease  in  flight  test  time  required.  Many 
parameters  are  obtained  from  a  single  msmoeuvre,  unlike  older  methods 
which  often  require  a  specific  stanoeuvre  for  a  given  parameter  on  a 
one-for-one  basis.  Manoeuvres  not  previously  amen2tble  to  analysis 
can  be  processed  without  difficulty. 

These  methods  are  now  used  extensively  overseas  and 
are  standard  for  stability  and  control  testing  it  many  establishments . 
Their  application  to  performance  flight  testing  is  still  under 
develcH^smr.t  due  to  more  stringent  acctiracy  requiresmnts .  Developments 
are  else  being  aimed  at  testing  in  non-linear  fli^t  regimes, 
particularly  high  angle-of -attack  manoeuvring. 

At  AKL,  the  Aircraft  Behaviour  Studies  -  Fixed  Wing 
Group  of  Aerodynamics  Division  cosmienced  activity  in  this  area  in 
the  mid  seventies.  The  principal  aim  has  been  to  aid  in  the 
development  and  validation  of  flight  dyneunic  mathematical  models 
of  aircraft  such  as  the  Mirage  and  the  FlllC.  The  Group  has  acquired 
or  developed  a  number  of  parameter  and  state  estimation  computer 
programm  and  obtained  experience  in  their  use  and  application  to 
flight  test  data  analysis.  It  is  the  purpose  of  this  Memo  to 
describe  these  prograsis,  including  their  advantages  and  disadvantages, 
and  to  point  to  aureas  of  application.  By  doing  so  it  is  hoped  that 
they  may  be  brought  to  the  attention  of  a  wider  range  of  potential 
users. 


It  should  be  noted  that  the  term  "system  identification” 
as  used  here  refers  to  a  cooplete  procedure  and  includes  consideration 
of  a  full  range  of  elements  much  as  manoeuvre  shape,  instrumentation 
accuracy,  data  acquisition  rates,  mathematical  model  definition  and 
so  on,  as  sumnarised  in  Figure  1.  Although  the  estimation  programs 
described  in  this  Msmo  are  an  essential  part  of  the  procedure,  the 
quality  of  the  results  obtained  will  depend  to  a  considerable  extent 
on  proper  consideration  being  given  to  each  of  the  other  elements. 


PRE¬ 
ESTIMATION 


ESTIMATION 


POST¬ 

ESTIMATION 


FIG.  1  INTEGRATED  SYSTEM  IDENTIFICATION  PROCEDURE 


2.  PARAMETER  ESTIMATION 

Before  proceeding  to  describe  the  programs,  some 
preliminary  remarks  may  be  useful.  The  par^UIleter  estimation  problem 
can  be  described  in  general  terms  as  follows:  The  system  investigated 
is  assumed  to  be  modelled  by  a  set  of  dynamic  equations  containing 
unknown  parameters.  For  exa]iq>le  the  equations  describing  aircraft 
dynamics  contain  the  aerodyn2unic  derivatives  as  unknowns.  The  system 
is  excited  by  a  suitable  input  and  measurements  made  of  the  input 
and  actual  system  response.  The  model  response  is  calculated  using 
the  ssune  input  and  the  model  parameters  are  adjusted  systematically 
so  that  the  model  response  matches  the  measured  response  as  closely 
as  possible. 

In  reality,  random  excitation  of  the  system  due  to 
unmeasured  sources  will  ^ULso  be  present.  A  typical  example  of  this 
for  aircraft  is  atmospheric  turbulence.  This  is  referred  to  as 
process  noise  (also  state  noise  or  input  noise) .  Thus  a  general 
description  of  the  actual  system  can  be  assumed  tc  oe  given  by  a 
system  of  differential  equations  of  the  form 

x(t)  =  f  (x(t),  u(t),  *  w(t)  (1) 

true 

where  f  is  in  general  a  non-linear  function  and 

X  is  the  state  vector 

u  is  the  input  vector 

C  is  the  vector  of  system  paraioeters 

w  is  the  process  noise  vector. 

Further,  measurements  of  the  response  Inevitably 
contain  errors,  both  of  a  deterministic  nature,  such  as  instrument 
bias  and  scale  factor  errors,  and  random  measurement  errors.  Thus 
the  response  measurements,  z{i),  can  be  assumed  to  be  described  by 

z(i)  -  g  (x(i),  u<i),  +  v(i)  (2) 

where  g  is  in  general  a  non-linear  function 
V  is  the  measurement  noise  vector 

i  is  a  discrete  time  point  at  «d>ich  the  measurements 

were  made. 
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The  unknown  parameter  vector,  C,  will  include  both 
system  parameters  and  parameters  modelling  instrument  systematic 
errors.  Unless  the  latter  are  adequately  modelled,  results  may 
be  seriously  in  error.  This  raises  the  question  of  modelling  real 
systems.  Physical  systems  are  seldom  described  by  sinple  dynamic 
models  and  this  iaplies  the  existence  of  modelling  errors. 

Commonly,  modelling  errors  are  singly  treated  as  process  and/or 
measurement  noise  in  spite  of  the  fact  that  they  may  be  deterministic 
rather  than  random. 

For  the  aircraft  case,  well-defined  linear  models 
have  been  established  for  small  disturbance  motions  about  an 
equilibrium  state.  However,  for  large  manoeuvres  or  for  high 
angles  of  attack  it  may  be  necessary  to  consider  non-line^u: 
representations  of  the  aircraft  motions. 

In  choosing  a  parameter  estimation  procedure 
consideration  needs  to  be  given  to  the  level  of  process  and 
measurement  noise  present,  whether  a  linear  model  is  em  adequate 
representation  of  the  system  or  whether  a  non-linear,  perhaps  ill- 
defined,  Biodel  needs  to  be  investigated.  The  programs  described 
in  the  next  section  offer  a  choice  in  line  with  these  considerations 
and  also  depending  on  what  masurements  are  available. 

3.  prcx:rams 


The  five  programs  to  be  described  are  presented 
roughly  in  order  of  increasing  cosplexity.  The  underlying  methods 
and  their  theoretical  properties  are  broadly  discussed  and  their 
range  of  applicability  outlined,  including  %dtether  process  and/or 
measurenient  noise  are  catered  for  emd  whether  a  linear  model  is 
assumed.  For  more  detailed  information  appropriate  references  are 
provided  for  the  reader  to  consult.  The  advantages  and  disadv^mtages 
of  each  method  are  also  discussed,  in  the  light  of  experience  obtained 
both  at  ARL  and  elsewhere.  The  programs  themselves,  including  input/ 
output  facilities,  are  only  described  in  fairly  broad  terms  and  the 
potential  user  will  need  to  consult  the  references  and/or  the  present 
author  for  more  specific  Information  about  their  operation  on  the 
ARL  counter. 

3.1  Equation  Error  -  Least  Squares 

To  Illustrate  this  approach  consider  the  following 
example:  It  is  assuaied  that  the  aerodynamic  force,  Z  acting  on  the 
aircraft  in  the  z-direction  can  be  represented  by 


bg  +  b^.a  +  bj.q  + 


+  b^.a*  +  bj.a6g  +  ^6’®e* 


Z 

a  ■  — 
2  m 


(3) 
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vrtiere  the  coefficients  bQ,  ..  etc.  (related  to  the  aerodynamic 
derivatives)  are  required  to  be  estimated,  and  measured  records  are 
available  for  the  independent  variable,  a^  (acceleration  in  the 
z-direction)  and  the  dependent  variables  a  (angle  of  attack) ,  q 
(pitch  rate)  and  (elevation  angle).  Note  that  the  assumed  model. 
Equation  (3),  contains  terms  non-linear  in  a  and  6^.  By  substituting 
values  for  measured  quantities  at  each  time  point  i,  the  equation 
can  be  written 


a  (i)  -  b-  -  b,.o(i)  -  b_.q(i)  -  ...  -  b,.6  *(i)  =  E(i)  (4) 

2  0  1  2  DO 

%diere,  because  Equation  (3)  is  only  an  approximation,  the  right 
hand  side  of  Equation  (4)  is  referred  to  as  the  Equation  Error,  and 
can  account  for  measurement  noise  iuid/or  modelling  errors.  Equation 
(4)  is  an  exaople  of  the  more  general  form 


y  =  X  5  +  £  (5) 

fchere,  referring  to  Equation  (4),  for  N  time  points 


y  * 

- a^(N)]^ 

e  = 

ted),  e(2),  - 

- e(n)3'^ 

— 

2  ' 

X  :: 

1  0(1),  q(l)  - 

- fie  (1) 

2 

1  0(2),  q(2)  - 

- fie  (2) 

.  . 

2 

1  a(N),  q(N)  - 

- fie  (N) 

and 


The  least  squares  estimate  for  the  un]cnown  para¬ 
meters,  given  the  measurements  of  y  and  X,  is 

5  =  (X  X)  X  y  (6) 

If  c(i)  are  zero  stean  and  independent  with  variance  o^, 
then  the  least  squeures  estimate  is  a  Best  Linear  Unbiased  Estimator 
with  cavaziance  of  the  estimates  given  by 

:!((5-5)  •=  (xTx)*l  o*  (7) 

and  the  value  of  can  be  estimated  from  the  sum  of  squares  of  the 
residuals  i.e. 

oa  »  — i-(y  -  -  xC)  (8) 

(N-p) 

with  p  being  the  dimension  of  the  parameter  vector, 
rurther  details  car.  be  found  in  References  1  and  2. 

I  Reference  2  demonstrates  the  important  reservation 

that  the  estimates  given  by  Equation  (6)  will  be  biased  unless  X  (the 
matrix  :f  dependent  variables)  is  measured  without  error  or,  as  mentioned 
above,  the  Equation  Error,  e(i),  is  zero  mean  and  white.  On  the 
other  hand,  process  noise  does  not  lead  to  biased  estimates.  Process 
noise,  in  this  case,  is  equivalent  to  a  model  of  the  form 

yj  •  X^  C  t  w  (9) 

where  the  subscript  T  denotes  true  values  and  w  is 
the  process  noise.  However,  process  noise,  as  well  as  measurement 
noise  on  the  independent  or  dependent  varied>les,  y  or  X,  does  lead  to 
degradations  in  accuracy  as  measured  by  the  covaricunce  of  the  estimates. 
Equation  (7) . 

Despite  these  deficiencies,  the  Equation  Error  method 
is  often  used  for  estimating  aerodynamics  from  flight  test  data  and 
can  be  expected  to  lead  to  good  results  when  measurement  noise  levels 
are  not  too  high.  Its  main  advantages  are  its  simplicity,  easy 
I  application  to  any  linear  or  non-linear  model  (Equation  (3))  and  its 

I  modest  oomputlng  demands.  A  practical  requirement  is  that  measurements 

I  y  of  all  the  variables  in  y  and  Z  must  be  available.  If  one  of  the 

measurement  channels  drops  out  then  the  method  breaks  down. 


A  least  squares  program  LSPROG  has  been  developed 
for  the  ASL  DEC  System  10  computer.  It  has  been  mitten  using  a 
robust  algorithm  based  on  the  Householder  transformation,  tdiich  has 
advemtages  when  the  equations  are  ill-conditioned  (Ref.  1).  A 
direct  solution  using  matrix  inversion  is  also  included.  The  inputs 
required  are  the  dimensions  of  the  X  matrix  and  tabulation  of  the 
y  and  X  measurements  at  each  time  point.  The  program  is  interactive 
and  will  calculate  specified  confidence  intervals  on  request. 

3.1.1  Progr^ul^  Options 

The  least  squ^tres  progrsun  LSPROG  provides  ttn  options 
which  have  been  found  useful  when  the  functional  form  of  the  fitted 
model  (Equation  (3))  is  uncertain.  The  first  option  allows  the  user 
to  try  various  constraints  on  the  solutions.  This  is  done  by 
specifying  a  set  of  constraint  relations  of  the  form 

L  C  =  C  (10) 

«diere  L  is  a  siatrix  of  dimension  s  by  p,  s  being 
the  nvonber  of  constraints  and  p  the  dimension  of  the  parameter  vector, 
while  C  is  a  vector  of  dimension  s.  The  value  of  s  ajnd  the 
elements  of  L  and  C  are  provided  interactively  by  the  user.  As  a 
simple  example,  one  or  isore  elements  of  C  could  be  set  to  sero. 

Further  details  of  the  method  can  be  found  in  Reference  1,  Chapter 

2. 

The  second  option  is  a  Bac)cward  Elimination  Procedure 
which,  starting  from  a  given  model  such  as  that  in  Equation  (3) , 
will  systeoiatically  eliminate  the  least  signific^mt  terms  until 
further  eliminations  became  statistically  unjustifyable  according  to 
a  pre-selected  level  of  significance.  The  final  result  is  a  best 
Regression  solution  tdtich  retains  only  those  terms  found  to  be 
significant  at  the  desired  level.  The  level  of  significance, 
specified  interactively  by  the  user,  is  a  measure  of  the  risk  of  error 
i.e.  the  probediility  of  retaining  a  term  when  it  should  be  eliminated 
(Type  I  error  in  statistical  hypothesis  testing) .  Details  of  the 
method  can  be  found  in  References  3  and  4. 


3.2  Output  Error  -  Maximum  Likelihood  (Linear  Systems) 

The  output  error  siethod  seeks  to  minimise  the 
difference  between  the  smasured  output  and  the  ax>del  output  (using  the 
same  input)  by  suitable  choice  of  the  unknown  parameters. 

For  the  pairticular  case  where  the  system  (e.g.  aircraft) 
can  be  described  by  a  set  of  linear,  constant  coefficient  equations. 
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and  where  there  are  no  gust  or  other  unknown  disturbances  (i.e.  no 
process  noise) ,  Equations  (1)  emd  (2)  can  be  written  as 


X  =  Ax  +  Bu 


(11) 


z(i)  =  C  x(i)  +  D  u(i)  +  b  +  v(i) 


(12) 


where  matrices  A,B,C,D  contain  parameters  (e.g. 
aerodynamic  derivatives)  defining  the  system,  b  is  a  constant  bias 
vector,  and  v  is  the  meastireiaent  noise  vector.  The  un)cnowr  parameter 
vector,  C,  contains  some  or  all  of  the  elements  of  A,B,C  and  D,  the 
unknown  biases  b,  and  the  initial  conditions. 


The  Maximum  Lilcelihood  (ML)  estimates  of  the  unicnown 
parameters  aire  those  for  which  the  observed  values  of  the  output,  z, 
would  be  most  li)<ely  to  occur  i.e.  the  conditional  probability 
density  p(z/^)  (the  probeibility  of  z  given  C)  is  maximised  with 
respect  to  If  the  measureatent  noise  vectors  v(i)  are  zero  mean 
independent  Gaussian  vectors  then  the  prolaability  density,  also  known 
as  the  Likelihood  function,  can  be  »<ritten 

P(z/i)  =  [2Tr”’|R[)  exp  {-i.I  [z(i)-z(i)j^  R  ^[z  i;-z(i)]} 

1=1 


(13) 

where  z  refers  to  the  expected  value  of  the  observa¬ 
tion,  z,  Euid  is  obtained  (for  no  process  noise)  from  Equation  (12)  , 
neglecting  v(i)  ,  after  siii^>le  integration  of  Equation  (11)  .  In 
Equation  (13),  R  is  the  nocm  measurement  noise  covariance  matrix,  with 
m  the  dimension  of  the  observation  vector,  z.  Instead  of  maximising 
p(z/C)  it  is  usual  to  minimise  a  cost  functional,  J,  obtained  by 
ta]iing  the  negative  log  of  p(z/C),  giving 

N  T  -1 

J(5,R)  •  i  N  logiRl  +  [z(i)-z(i)]  R  [z(i)-z(i)] 


(14) 

The  M.L.  method  thus  finds  a  set  of  parameters,  C, 
which  minimises  the  cost  function  J  defined  by  Equation  (14) .  If  R 
is  not  )utown  then  zui  estimate  for  R  can  be  obtained  by  minimising  J 
with  respect  to  R,  which  results  in  the  following  estimate  for  the 
covariance  matrix 

,  N  -  .  T 

R»l.j;,  (z(i)-z(i))  (z(i)-z(i)f 
H  1*1 


(15) 


1 

( 


I 


! 

t 
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Estimates  of  the  unknown  parameters ,  C ,  ere  then 
obtained  by  minimising  J  with  respect  to  C,  with  R  from  Equation 
(15)  replacing  R.  Since  J  is  a  non-linear  function  of  Cr  an 
iterative  technique  is  required  to  do  this.  A  coianon  choice  is  a 
i  modified  Newton-Raphson  algorithm  (Ref.  5) .  The  new  value  of  C 

thus  obtained  can  bemused  to  calculate  a  new  z(i)  and  hence  a 
revised  estimate  of  R  follows  from  Equation  (15) .  This  two-step 
procedure  can  )}e  repeated  until  convergence  is  achieved. 

The  ML  estimates  are  unbiased  and  consistent  i.e. 
they  converge  to  the  true  values  for  large  N.  Provided  that  the 
noise  vectors  are  independent,  the  estimates  are  also  efficient  i.e. 
the  covaricince  of  the  estimates  approaches  the  Cramer-Rao  lower 
]30und  for  large  N  (Ref.  1).  Interpretation  of  the  Cramer-Rao  bound 
for  real  flight  data  is  discussed  in  Reference  6.  The  Cramer-Rao 
bound  and  hence  the  covariance  of  the  estimates  is  readily  calcula¬ 
ted  as  follows 

E{  (5-^)  (C-^)*^}  =  {  ?  A^ii)  r‘^  A(i)}‘^  (16) 

i=l 

where  A  is  the  sensitivity  ^trix  whose  elements  are 
the  partial  derivatives  of  the  elements  of  z  with  respect  to  the 
elements  of  i.  The  calculation  of  A  is  also  required  in  the  basic 
Newton-Raphson  algorithm  to  solve  for  the  unJtnown  parameters,  C,  and 
•  follows  from  Equations  (11)  and  (12). 

The  present  Output  Error  (OE)  isethod,  unlike  the 
Equation  Error  (EE)  method  of  the  previous  section,  can  cope  with  the 
loss  of  a  data  channel,  simply  by  setting  the  relevant  element  of 
the  weighting  matrix,  R~^  to  zero.  Since  the  complete  system  of 
equations  is  treated  simultauteously,  information  can  be  passed  between 
equations  so  that  parameter  estimates  can  still  be  obtained.  Such 
a  trade-off  is  not  possible  with  the  EE  method  which  treats  each 
equation  independently  of  the  others.  Computing  tiaie  is  considerably 
longer  for  the  OE  method  than  for  the  EE  approach.  However,  the 
main  disadvantages  of  the  OE  method  as  applied  here  are  the  limita¬ 
tion  to  linear  models  and  the  degradation  of  the  results  in  the  presence 
of  process  noise.  While  measurement  noise  is  handled  well,  process 
noise  (i.e.  unmodelled  disturbances  or  possibly  due  to  modelling  errors) 
may  result  in  the  program  not  converging  or  in  poor  estimates  with 
large  covariances.  In  this  sense  it  is  coiqplementary  to  the  EE 
I  approach  which  copes  well  with  process  noise  but  not  with  measurement 

i  ^  noise.  The  OE  method  has  been  widely  applied  to  aircraft  testing  for 

I  ;  several  years  and  works  very  %iell  with  linear  flight  regimes  etnd 

smooth  test  conditions.  Extensions  to  handle  process  noise  and  applica¬ 
tions  to  non-linear,  but  well  defined  models,  are  considered  in 
subsequent  sections. 
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The  method  described  in  this  section  is  the  basis 
of  the  ARL  program  NEWTN4,  a  slightly  modified  version  of  the  progreun 
described  in  Reference  5.  A  detailed  description  of  the  program, 
including  input  requireronts  and  output  produced,  is  given  in 
Reference  5.  Briefly,  inputs  include  information  defining  the  system 
matrices,  weighting  matrices  euid  parameters  to  be  estimated  as  tiell 
as  input  and  response  measurement  time  histories.  The  outputs 
include  a  convergence  history,  fit  errors  and  the  resulting  pareuneters 
and  their  cov^u:iances .  The  program  allows  the  user  to  set  the 
weighting  matrix,  R“^,  thereby  fixing  the  relative  worth  of  each 
observation  channel  (or  cong>onent  of  the  measurement  vector,  z) . 
Examples  of  its  use  at  ARL  are  reported  in  References  7  emd  8.  Easy 
application  and  generally  good  performance  make  the  progreus  very 
suitable  for  stability  and  control  flight  testing,  where  a  well 
established  llneau:  model  exists  for  describing  aircraft  response  to 
control  inputs. 

3.2.1  A  Priori  Option 

If  information  about  scxne  elements  of  the  parameter 
vector,  Z,  is  available  from  other  sources  (e.g.  wind  tunnel, 
theoretical  estimates  or  previous  tests) ,  then  it  is  sometimes 
desirable  for  the  estimating  algorithm  to  consider  this  a  priori 
information  in  addition  to  the  new  data  from  the  current  manoeuvre. 

In  NEWTN4  this  is  acconplished  by  adding  to  the  cost  functional  of 
Equation  (14)  a  quadratic  penalty  term  for  departure  from  the  a 
priori  value 


«diere  Cq  is  the  vector  of  a  priori  values  and  W 
is  the  a  priori  weighting  matrix  set  by  the  user.  Clecurly  the  penalty 
dj  will  be  zero  \dien  C  **  will  increase  for  any  departure 

from  ^  Such  an  increase  would  be  countered  by  a  decrease  in  the 
rest  of  the  cost  functional  J  (Eqn.  14).  Components  of  the  parameter 
vector,  will  thus  only  depart  from  if  there  is  sufficient 
information  in  the  new  data  to  justify  this.  If  J  (Eqn.  14)  is 
very  weakly  dependent  on  a  particular  parameter  then  the  a  priori 
option  will  ensure  that  its  estimated  value  will  not  depart  far  from 
the  a  priori  value.  This  feature  can  be  used  to  check  whether 
significant  information  on  a  specific  parameter  is  available  from 
the  new  data.  For  exai^le  if  the  covariance  of  the  estimate  is 
significantly  less  than  that  implied  by  the  a  priori  weight  (or 
element  of  the  W  smtrix  in  Eqn.  (17))  then  it  can  be  concluded  that 
the  new  data  contains  worthwhile  information  on  that  parasieter. 
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However,  care  must  be  taken  in  the  use  of  the  a 
priori  option  since  results  will  inevit^d>ly  be  biased  towards  the 
a  priori  values,  the  amount  of  bias  depending  on  the  weighting  matrix 
W.  Thus  results  should  be  checked  with  decreasing  values  of  W  and, 
finally,  with  the  a  priori  option  removed. 

3.3  Generalised  Maximum  Likelihood  (Linear  Systems) 

The  output  error  method  described  in  the  previous 
section  can  be  generalised  to  the  case  where  process  noise  is 
present.  For  a  linear  system  with  zero  mean,  white  Gaussian 
w(t).  Equations  (1)  £uid  (2)  can  be  written 

x(t)  -  Ax(t)  +  B  u(t)  +  w(t)  (18) 

z(i)  =  C  x(i)  +  D  u(i)  +  v(i)  (19) 

The  N2uci]mim  Likelihood  approach,  as  in  section  3.2, 
minimises  the  negative  log  of  the  Likelihood  function,  resulting  in 
the  following  cost  functional  to  be  minimised: 

J(e,G)  -  JN  loglcl  +  i  (z(i)-z(i))^  G’^Iz(i)-z(i)l  (20) 

i*l 


where  z  is  the  exi>ected  value  (or  predicted  estimate) 
of  z  and  G  is  the  covariance  of  the  residuals,  z(i)-z(i).  Equation 
(20)  is  identical  to  Equation  (14)  except  that  z  is  now  coiic>uted 
using  a  Kalman  Filter,  idiich  provides  an  optimal  estimate  taking  into 
account  both  process  and  measurement  noise,  and  R  is  replaced  by  G, 
which  includes  information  on  both  measurement  and  process  noise 
covariances.  Equation  (14)  can  be  viewed  as  a  special  case  of 
Equation  (20)  for  zero  Kalman  gain.  Detailed  discussion  of  Kalman 
Filtering  can  be  found  in  Reference  9. 

The  discussion  of  section  3.2  relating  to  solution 
of  the  minimisation  problem,  the  asyoptotic  properties  of  the  method 
and  the  estimated  covariances  of  the  results  (Eqn.  (16) )  applies 
also  to  this  section  provided  R  is  replaced  by  G  and  z  is  understood 
to  be  the  output  of  a  Kalman  Filter. 

The  computer  program  MMLE3,  described  in  detail 
in  References  10  and  11,  has  been  implemented  on  the  ARL  cosputer. 
MKLE3  has  evolved  from  the  earlier  program  of  Reference  5  luid,  apaurt 
from  the  generalisation  to  handle  process  noise,  has  more  flexible 
input/output  facilities  and  inbuilt  plotting  capabilities,  designed 
to  make  the  task  of  the  user  as  easy  as  possible.  The  program  is 
organised  into  two  levels.  At  the  basic  level  it  consists  of  a 
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general  maxinnim  likelihood  progr£uti  applicable  to  any  linear  system. 
At  the  second  level  it  can  be  adapted  to  a  particular  application 
through  a  set  of  routines  %Atich  can  be  tnritten  or  modified  by  the 
user  for  that  particular  application.  Having  done  this,  the  program 
input  does  not  then  have  to  contain  the  detailed  system  specifica¬ 
tions  but  only  those  items  vihich  change  from  case  to  case.  In 
particular,  a  set  of  standard  aircraft  user  routines  are  provided 
for  the  aircraft  longitudinal  or  lateral  stability  and  control 
problem  with  no  turbulence. 

The  process  noise  capcd>ility  of  MMLE3  should  be 
approached  with  considerable  care  since  this  feature  guarantees  a 
good  fit  between  the  measured  and  estimated  responses.  Therefore 
possible  modelling  problems,  which  would  ordinarily  lead  to  a  poor 
fit,  may  not  become  apparent.  Thus  it  may  be  advisable  for  the 
inexperienced  user  to  avoid  using  this  cap>2d>ility  before  gaining 
a  clear  understanding  of  all  aspects  of  the  program  and  the 
particular  problem  in  hand. 

MMLE3  also  has  an  a  priori  option  idiich  can  be 
switched  off  after  a  specified  number  of  iterations.  Reference  9 
recomnends  that  this  be  done  to  allow  the  last  few  iterations  to 
run  without  a  priori  weighting,  and  thus  achieve  an  unbiased  result. 

3.4  Maximum  Likelihood  (Won -Linear  Systems) 

With  this  progreun  the  method  of  section  3.2  is 
extended  to  deal  with  non-lineeu:  models  but  is  restricted  to  the  no 
process  noise  case.  Thus  the  system  model  is  represented  by 

i(t)  =  f(x(t),  u(t),  C)  (21) 


z(i)  =  g(x(i),  u(i),  t)  +  v(i) 


(22) 


The  general  procedure  is  identical  to  that  described 
in  section  3.2.  In  the  present  case  the  expected  values  of  the 
output,  z,  are  obtained  by  integrating  Equation  (21)  and  substitu¬ 
ting  for  x(i)  into  Equation  (22)  (neglecting  v(i)).  Since  the  form 
of  the  non-linear  functions,  f  and  g  in  Equations  (21)  and  (22) , 
will  differ  from  problem  to  problem  the  user  must  provide  subroutines 
to  carry  out  these  calculations  for  each  specific  problem.  In 
addition,  the  user  must  provide  for  the  calculation  of  the  sensitivity 
matrix.  A,  which  is  required  both  in  the  Mewton-Raphson  solution 
algorithm  and  also  in  the  calculation  of  the  covariance  matrix  of 
the  estimates.  Equation  (16).  As  noted  in  section  3.2,  the  elajmts 
of  A  are  the  derivatives  of  the  elements  of  the  output  vector,  z, 
with  respect  to  the  elements  of  the  parameter  vector,  C,  and  their 


calculation  will  be  problem  dependent.  The  general  properties  of 
the  maximum  likelihood  method  and  its  advwtages  aund  disadvantages 
are  as  discussed  in  section  3.2. 

A  coo^Juter  program  which  has  evolved  from  the 
program  of  section  3.2  has  been  trritten  for  the  ARL  ccmputer  to 
implement  the  procedure.  The  problem  dependent  aspects  referred 
to  above  require  the  user  to  provide  a  number  of  specific  sub¬ 
routines  to  define  the  system.  The  structure  of  the  program  and 
requirements  of  the  user  supplied  subroutines  are  described  in 
Reference  12.  Input  and  output  data  cure  also  described  and  are 
broadly  similar  to  that  outlined  in  3.2. 

Reference  12  describes  a  particular  application  of 
the  program  to  the  conpatibility  checking  of  Flight  steasturements. 

By  suitably  reformulating  the  kinematic  equations  describing  the 
aircraft  motion,  instrument  systematic  errors  such  as  biases  and 
scale  factor  errors  can  be  Identified,  and  a  consistent  set  of 
'error-free'  swasurements  obtained.  At  the  same  time,  missing 
records  can  be  reconstructed  if  required.  With  a  complete  set  of 
clean  oieasureaients  thus  available,  a  second  stage  of  analysis  can 
proceed  to  extract  aerodynamic  parameters  and  possibly  examine 
alternative  aerodynamic  model  structures  such  as  that  of  Equation 
(3).  The  regression  program  of  section  3.1  may  be  a  useful  method 
of  doing  this  and  would  be  expected  to  yield  good  results  in  the 
presence  of  small  measurement  errors.  The  two  stage  procedure 
proposed  allows  instrument  errors  to  be  processed  separately  from 
any  consideration  of  the  aerodynasiic  model  or  pareuneters.  The 
ability  to  check  the  conpatibility  of  the  steasured  data  is  in  fact 
a  useful  facility  Irrespective  of  the  subsequent  analysis. 

3.5  Extended  Kalman  Filter 

In  the  most  general  case,  a  non-linear  model  nay 
be  required  to  describe  adequately  the  system  under  consideration, 
and  both  process  euid  measurement  noise  may  be  present.  This  case 
is  sunmarised  by  Equations  (1)  and  (2)  which  are  repeated  below 

X  -  f(x(t),  u{t),  £)  +  w(t)  (23) 

z(i)  -  g(x(i),  u{i),  K)  +  v(i)  (24) 

The  extended  Kalman  Filter  (EKF)  is  an  approximate 
filter  for  non-linear  systems,  based  on  first  order  linearisation 
of  the  state  and  outinit  eq\iations  about  the  best  estimate  of  the 
state  at  each  data  point.  The  filter  consists  of  prediction 
equations,  where  the  expected  value  of  the  state  is  predicted  one 
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step  ahead,  and  neeurenent  t^pdate  equations,  id>ere  the  measured  data 
o£  that  tiste  point  are  used  to  vis>date  the  predicted  value,  although 
the  Kalaian  Filter  is  a  State  estlnator  it  can  be  applied  to  Paranster 
estiaation  by  including  the  unknown  paraneters  in  the  state  vector. 
This  is  done  by  augnenting  the  system  state  vector,  x,  with  the 
parameter  vector,  so  that  the  augmented  state  vector,  x^,  becomes 

-  Ix,5)’’  (25) 


are 


The  state  equations^  in  addition  to  Equation  (23) , 

£  -  0  (26) 


since  the  unknown  parameters,  eure  assuaied  to  remain 
constant  with  time.  Thus,  while  the  par2u»eters  remain  constant  between 
measurements,  they  are  t^dated  with  the  new  information  at  each  data 
point.  Including  the  parameters  as  state  variables  in  tlvis  way 
increases  the  non-linearities  in  Equation  (23) ,  tdiich  is  already  non¬ 
linear  in  structure.  Successful  application  of  the  EKF  depends  on  the 
accuracy  of  the  linearisation  process.  For  sufficiently  small  step 
size  good  results  can  be  obtained,  and  in  this  case,  since  the  EKF 
estimates  arc  essentially  the  maximum  likelihood  estimates,  the 
properties  of  the  EKF  estimator  are  identical  to  those  smntioned  in 
section  3.3  (Ref.  2). 

The  main  disadvantage  of  the  method  is  the  need  for 
information  on  the  noise  statistics  euid  for  a  priori  covekriances 
which  are  uniuicwn  for  the  parameters.  If  the  a  priori  values  for  the 
parameters  are  poor,  then  the  method  can  fail  to  converge  (Ref.  2) . 

An  EKF  program  has  been  developed  at  ARL  and  is 
described  in  Reference  13.  At  present  the  program  is  specifically 
configured  to  deal  with  the  compatibility  checking  problem  outlined 
in  section  3.4.  The  use  of  the  EKF  allows  the  inclusion  of  process 
noise  in  the  formulation  of  that  problem.  Neglect  of  the  process 
noise  leads  to  an  underestixmte  of  the  resulting  parameter  covariances, 
whereas  the  EKF  will  calculate  these  correctly,  in  theory.  A 
cosparison  of  the  two  approaches  has  been  made  in  Reference  14  %fhere 
the  theoretical  advantage  of  the  EKF  was  only  seen  to  be  achieved 
with  low  noise  levels.  Further  development  is  in  progress. 

Application  of  the  ARL  EKF  program  to  other  non-linear  systems  tiould 
require  some  re-wrlting  of  those  sections  of  the  program  which  deal 
with  the  problem  formulation. 
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4.  CONCLUDING  REMARKS 

A  brief  overview  of  the  application  of  System 
Identification  methodology  to  the  analysis  of  dynamic  flight  test 
data  has  been  provided,  showing  the  parameter  estimation  program 
as  an  iiportcint  element  in  the  overall  process.  Advantages  of 
the  System  Identification  approach  have  been  summarised  in  the 
Introduction.  A  number  of  estimation  programs,  making  use  of  least 
squares,  maximum  likelihood  and  Kalman  filter  procedures,  are 
available  on  the  ARL  computer  and  have  been  described  in  this  Memo. 
Advantages  and  disadvcintages  of  each  method  have  been  pointed  out. 

In  choosing  a  program,  a  number  of  aspects  of 
the  particular  problem  in  hand  need  to  be  considered.  These  include; 

(i)  the  size  and  structure  of  the  mathematical 
model,  whether  well-defined,  linear  or 
otherwise , 

(ii)  the  level  of  process  and  measurement  noise 
present, 

(iii)  the.  measurements  available. 

Thus,  if  suitable  measurements  of  all  required 
quantities  are  available  and  measurement  noise  levels  are  small,  the 
least  squares  approach  (section  3.1)  has  been  shown  to  yield  good 
results  even  in  the  presence  of  process  noise,  and  has  the  added 
advcUitage  that  non-linear  representations  can  be  assumed.  Further, 
the  program  provides  a  capability  for  con^aring  different  model  struc¬ 
tures  and  choosing  the  most  significemt. 

If  a  well  established,  linear  model  is  available, 
such  as  that  describing  aircraft  sted>ility  and  control  over  a 
restricted  angle  of  attack  range,  the  use  of  a  miucimum  likelihood 
program  (e.g.  section  3.2)  is  a  good  choice  and  can  be  used  even  when 
some  output  measurements  are  not  available.  In  the  presence  of 
significant  process  noise  a  generalised  maximum  likelihood  scheme 
(section  3.3)  can  be  used. 

For  a  non-linear  model  with  not  all  output  qucintities 
measured,  the  non-linear  maximum  likelihood  approach  at  section  3.4 
can  be  expected  to  give  reasonable  results  if  process  noise  levels 
are  low.  Alternatively,  a  ttfo  stage  procedure  as  outlined  in 
section  3.4  may  be  preferred  especially  if  the  number  of  unknown 
parameters  is  large.  With  a  significant  level  of  process  noise 
this  would  require  the  use  of  a  procedure  such  as  the  Extended  Kalnum 
Filter  of  section  3.5. 
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Specific  information  on  the  running  of  these  programs 
on  the  ARL  conputer  is  provided,  to  a  large  extent,  in  the  cited 
references.  For  additional  information  the  potential  user  is  invited 
to  contact  the  present  author. 
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A  brief  overview  of  the  application  of  System  Identification 
methodology  to  the  analysis  of  dynaisic  flight  test  data  is  provided, 
and  the  advMtages  of  this  approach  susnarised.  Paraimeter  estimation 
is  presented  as  an  important  element  in  the  overall  process  and  a 
number  of  estiamtion  prograsw,  available  on  the  ARL  cosputer,  are 
described.  The  advantages  and  disadvantages  of  the  various  procedures 
including  least  squares,  maximum  likelihood  and  Kalman  filter 
techniques,  are  assessed.  Suggestions  are  made  on  factors  to  consider 
in  choosing  the  most  suitable  amthod,  depending  on  measurements 
available ,  noise  levels  and  audel  structure .  ^ 


I 


This  page  is  to  be  used  to  record  informatior\  which  is  required  by  the  Establishment  for  its  own  use  but 
which  will  not  be  added  to  the  OISTIS  data  base  unless  spedfioBlty  requested. 


.1... 

END 

DATE 

FILMED 

6  83 


